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Abstract 

In heterogeneous dense networks where spectrum is shared, users privacy remains one of 
the major challenges. On a multi-antenna relay-assisted multi-carrier interference channel, each 
user shares the frequency and spatial resources with all other users. When the receivers are not 



> 

CO ■ only interested in their own signals but also in eavesdropping other users' signals, the cross talk 

\ on the frequency and spatial channels becomes information leakage. In this paper, we propose 

a novel secrecy rate enhancing relay strategy that utilizes both frequency and spatial resources, 
. termed as information leakage neutralization. To this end, the relay matrix is chosen such that the 

effective channel from the transmitter to the colluding eavesdropper is equal to the negative of the 
effective channel over the relay to the colluding eavesdropper and thus the information leakage 



H . to zero. Interestingly, the optimal relay matrix in general is not block-diagonal which encourages 

users' encoding over the frequency channels. We proposed two information leakage neutralization 
strategies, namely efficient information leakage neutralization (EFFIN) and optimized information 
leakage neutralization (OPTIN). EFFIN provides a simple and efficient design of relay processing 
matrix and precoding matrices at the transmitters in the scenario of limited power and computational 
resources. OPTIN, despite its higher complexity, provides a better sum secrecy rate performance by 
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Fig. 1. Three overlapping LTE cells. The sum secrecy rates over the cells can be improved if a smart multi-antenna relay 
is introduced into the system. The emphasized arrows from BS 1 to the smart relay in the middle and then to UE 1 illustrate 
that desired signal strength (together with the direct channel path in red) can be boosted by choosing an appropriate relay 
strategy. The emphasized arrows from BS 2 to the smart relay and then to UE 1 illustrate that information leakage (shown 
by a dashed arrow in blue) can be neutralized by choosing the relay strategy appropriately. 



optimizing the relay processing matrix and the precoding matrices jointly. The proposed methods 
are shown to improve the sum secrecy rates over several state-of-the-art baseline methods. 

Index Terms 

Interference relay channel; Interference neutralization; Non-potent relay; Full-duplex relay; 
Amplify-and-forward relay; secrecy rate; worst-case secrecy rate; frequency selective; multi-antenna 
systems; coUuding eavesdroppers 

I. Introduction 

The trend of future wireless network systems is towards spectrum sharing over different 
wireless infrastructures such as LTE networks, smart grid sensor networks and WiMAX 
networks. With isolated wireless infrastructures, such as multiple non-cooperating LTE cells 
(as shown in Figure H]), ensuring data security remains a major technical challenge. While 
cryptography techniques are employed in most established communication standards, physical 
layer security techniques provide an alternative approach when the communicating front-ends 
are of limited computation capability and are not able to carry out standard cryptography 
methods such as symmetric key and asymmetric key encryption. These applications include 
but are not limited to ubiquitous or pervasive computing [1]. 

With the high demand of wireless applications in recent years, the issues of communication 
security become ever more important. Physical layer security techniques [2]-[4] provide an 
additional protection to the conventional secure transmission methods using cryptography. As 



early as four decades ago, the seminal work on the secrecy capacity on the wire-tap channel 
[5] - the most fundamental model consisting one source node, one destination node and 
one eavesdropper - started the era of research on physical layer security. Extensive analysis 
and designs have been conducted ever since; physical layer security results can be found in 
[2]-[4] and recent tutorial papers [6], [7]. 

With advantages such as increased cell coverage and transmission rates, relays are incor- 
porated into the standards of current wireless infrastructures. The wireless resources in these 
systems are frequently shared by many users/subscribers and a potential malicious user in the 
system can lead to compromised confidentiality. Many novel strategies have been proposed 
to improve the secrecy in 

• relay systems, including cooperative jamming (CJ) [8]-[10], noise-forwarding (NF) [11], 
a mixture of CJ and NF [12], signal-forwarding strategies such as amplify-and-forward 
(AF) and decode-and-forward (DF) [13]-[15j]. 

• multi-carrier systems [19]-[21] and multi-carrier relay systems with external eavesdrop- 
per(s) [14], [22]. 

Yet, a joint optimization of secrecy rates over the frequency-spatial resources in a relay- 
assisted multi-user interference channel (with internal eavesdroppers) remains an open pro- 
blem, as considered here. 

We assume that the relay employs an amplify-and-forward (AF) strategy which provides 
flexibility in implementation as the relay is transparent to the modulation and coding schemes 
and induces negligible signal processing delays [23]. The novel notion of relay -without- 
delays, also known as instantaneous relays if the relays are memory less [24]-[27], refers to 
relays that forward signals consisting of both current symbol and symbols in the past, instead 
of only the past symbols as in conventional relays. As shown in Figure |2l the instantaneous 
relay model provides a matching model of layer- 1 repeaters connected networks (such as LTE 
networks) and helps us analyze the system performance of nowadays repeaters connected 
network^. 

'All aforementioned works assume that the relays are cooperative and trusted. For secure transmission strategies with 
untrusted relays, please refer to [16]~[18]. 

^In modem networks such as LTE, wireless links are often connected using boosters or layer- 1 repeaters (simple amplifiers) 
[28]. If the time consumed for the signals to travel from a source to a repeater or from a repeater to a destination is counted 
as one unit, then the total time for the signal to travel from a source to a destination is two units - the same amount of 
time for the signal to travel from a source through a smart AF relay to a destination. 
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In order to provide secure transmission over relay-assisted multi-carrier networks, we 
propose a relay strategy termed as information leakage neutralization which by choosing relay 
forwarding strategies algebraically neutralizes information leakage from each transmitter in 
the network to each eavesdropper on each frequency subcarrier. This method is adopted from 
a technique on relay networks, termed as interference neutralization (IN). IN has been applied 
to eliminate interference in various single-carrier systems, such as deterministic channels [29], 
[30], two-hop relay channels [23], [31], [32] and instantaneous relay channels [33]. Our prior 
work shows that IN is effective in improving secrecy rates in a two-hop wiretap channel [34]. 
The proposed method in this paper differs from previous works above as the neutralization 
over multi-carrier systems is of high complexity. Another important difference is that here 
the colluding eavesdroppers as well as the relays have multiple antennas. 

The contribution and outline of this manuscript are summarized as follows: 

• We transform a general and complicated sum secrecy rate optimization problem on a 
relay-assisted multi-carrier interference channel with mutually eavesdropping users to an 
optimization-ready formulation. Systematic optimization techniques can then be applied 
to solve for the sum-secrecy-rate-optimal relay strategies and precoding matrices at the 
transmitters. 

• An illustrative example is given in Section III-AI for a basic setting to highlight the 
efficiency of information leakage neutralization. 

• We propose a novel idea of information leakage neutralization strategies in Section ITlI-Ai 
These strategies neutralize information leakage from each user to its colluding ea- 
vesdroppers on each frequency-spatial channel. The resulting secrecy rate expression 
is significantly simplified. Detailed analyzes for the multi-carrier information leakage 
neutralization methods are provided. In particular, the minimum number of antennas at 
the relay for complete information leakage neutralization is computed in Proposition 
1. The required number of antennas depends on the number of data streams sent by 
each user, the number of frequency subcarriers and the number of users in the system. 
Relevant to applications where relay power must be reserved, the minimum power at 
the relay required for information leakage neutralization is computed in Proposition 2. 

• We propose an efficient and simple information leakage neutralization strategy (EFFIN) 
which ensures secure transmissions in the scenarios of limited power and computational 
resources at relay and transmitters. With sufficient power at the relay, we propose an 
optimized information leakage neutralization technique (OPTIN) to maximize the secrecy 
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rates while ensuring zero information leakage. 
• The achievable secrecy rates from proposed strategies EFFIN and OPTIN are compared 
to several baseline strategies by numerical simulations in Section |Vl Baseline 1 is a 
scenario where the relay is a layer- 1 repeater and baseline 2 is a scenario with no relay. 
Simulation results show that the proposed strategies outperform the baseline strategies 
significantly in various operating SNRs. 

A. Notations 

The set C*^^* denotes a set of complex matrices of size a by & and is shortened to 
C° when a = b. The notation A/'(A) is the null space of A. The operator (g) denotes 
the Kronecker product. The superscripts ^, ^, t represent transpose, Hermitian transpose 
and Moore-Penrose inverse respectively whereas the superscript * denotes the conjugation 
operation. The Euclidean norm for scalars is written as | . | . The trace of matrix A is denoted 
as tr(A). Vectorization stacks the columns of a matrix A to form a long column vector 
denoted as vec(A). The function C(A) denotes the log- determinant function of matrix A, 
logdet (A). The identity and zero matrices of dimension K x K are written as I^^ and Ok- 
The vector represents a column vector with zero elements everywhere and one at the i-th 
position. The notation [A]mi. denotes the m-th row and l-th column element of the matrix 
A. The notation p^.^, < a < 6 < n, denotes a vector which has elements \pa,Pa+i, ■ ■ ■ iPb] 
where p = [p^, . . . 

IL System Model 

In the following subsection, we give an example of a two-user interference relay channel 
in which the relay has two antennas and all nodes share two frequency subcarriers. We shall 
illustrate that the conventional assumption of block diagonal relay matrix (which maximizes 
achievable rates in peaceful systems) cannot be adopted a-priori when secrecy rates are 
considered. 

A. An example of two users on two frequencies with two antennas at the relay 

Transmitter i, z = 1, 2, transmits symbols Xj G C*^^^ which are spread over M frequency 
subcarriers by precoding matrix Pj. For the ease of notation, we assume that precoding 
matrix Pj is a square matrix Pj G C^^. When user i transmits Si < M symbols, then zeros 
are padded in Xj so that its dimension is always M x 1 and correspondingly zero columns 
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(a) a relay-assisted network 
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(b) instantaneous relay network 



Fig. 2. The wireless relay-assisted network with layer one repeaters and one smart relay is shown in subfigure (a). The dotted 
lines demonstrate the equivalent links between a source and a destination taking into account the presence of the repeaters. 
All paths from source to destination nodes take two time slots and links from source to relay and relay to destination 
take one time slot. The equivalent channel is established in subfigure (b) by replacing the relay as an instantaneous relay. 
Information going through the instantaneous relay arrives at the destinations at the same time as over the direct links. 



are padded in Pj. We assume that the users do not overload the system and therefore Si is 
smaller than or equal to the number of frequency subcarriers, here two. Note that Pj may 
have low row rank when certain subcarriers are not used. For example, if user i transmits one 
symbol on subcarrier 1 but nothing on subcarrier 2, then Pj — [o, 0; 0, 0] for some complex 
scalar a. If Pj is diagonal, then each symbol is only sent on one frequency. Denote the m-th 
transmit symbol of user i as Xj(m) which is randomly generated, mutually independent and 
with covariance matrix I2. The precoding matrix Pj satisfies the transmit power constraint 
of user i: tr (Pj Pf ) < pv^"-^. Denote the channel gain from transmitter (TX) i to receiver 
(RX) j on frequency m as hji{m). For simplicity of the example, we let Si equal two. The 
received signal of user Hs a vector whose m-th element is the received signal on the m-th 
frequency subcarrier. 



y.(i) 
yi(2) 



2 

E 



hij{l) 


P. 


3^.(1) 


+ 


ni{l) 


hij(2) 




xj{2) 




nj(2) 



(1) 



The circular Gaussian noise with unit variance received on the m-th subcarrier at RX i is 
denoted as ni{m). If a relay with two antennas is introduced into the system, it receives the 



6 



broadcasting signal from TXs and forwards them to RXs. We denote the received signal at 
the relay as a stacked vector of the received signal at each frequency m, with yj.{m) e C^^^ 
representing the received signal on frequency m and the a-th element in yj.(m) representing 
the signal at the a-th antenna: 

2 
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n,(2) 



(2) 



f,(l) 02x1 

^ 02x1 f,(2) 

where 11^(771) e C^^^ is a circular Gaussian noise vector received at frequency m with 
identity covariance matrix and fj (m) is the complex vector channel from user j to the relay 
on frequency m. The relay processes the received signal y,, by a multiplication of matrix 
R G and forwards the signal to the RXs. Denote the channel from relay to RX i on 
frequency m by gj(m) e C^^^. At RX i, the received signal is 
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Denote channel matrices 



H 



V 







f.-(l) 02x1 
02x1 f,(2) 



g?(l) Oix2 
Olx2 g?(2) 

and the equivalent channel from TX j to RX i as Hj^ = Hjj + Gf R . An achievable rate 
of user 1 is 

-1^ 



ri (R) = C ( I2 +Hn Pi Pf Sf, ( H12 P2 P^ + Gf R R^ Gi + h 



HttH 



(4) 

Consider that RX 2 is an eavesdropper. We compute the worst-case scenario in which RX 2 
decodes all other symbols perfectly before decoding the messages from TX 1 and RX 2 sees 
a MIMO channel and decodes messages xi{l) and 2:2(2) utilizing both frequencies (with a 
MMSE receive filter for example). 
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An achievable rate is then r2^i(R) = C {I2 +H21 Pi Pf hJ (G^ RR^ G2 + 12) ^) • An 
achievable secrecy rate of user 1 is then the achievable rate of user 1 ri(R) minus the leakage 
rate to user 2 r2^i(R) [35]: 

ri^(R) = (ri(R)-r2^i(R)) + 



C [I2 +Hn Pi Pf fif, (^Hi2 P2 P" + Gf R R" Gi + I2 

- C (I2 +H21 Pi Pf H^i (Gf R R^ G2 + 12) j . 
The relay processing matrix is defined as 

Rii R12 
R21 R22 

where each submatrix block Rmn forwards signals from frequency n to frequency m. In a 
peaceful MIMO IRC, R bares a block diagonal structure, R12 = R21 = O2. The intuition is 
that relays should not generate cross talk over frequency channels. However, it is not trivial to 
examine the effect of R12 and R21 on secrecy rates as illustrated below and the conventional 
block diagonal structure should not be a-priori assumed. 

As a numerical example, we compute the secrecy rates with the following randomly 
generated channels given in Table HI We set the precoding matrices of TX 1 and TX 2 
to be 



HtjH 



-1 



(6) 



R 



(7) 
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Pl = 




, P2 = 
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which means that TX 1 transmits only one data stream on both subcarriers and TX 2 transmits 
two data streams spread over both frequency subcarriers with orthogonal sequences. With 
relay matrix R™ (see Table U) a sum secrecy rate of 3.4104 is achievable whereas with 
block diagonal matrix R™'"^ the sum secrecy rate is 3.1881. A block diagonal relay matrix 
does not always improve secrecy rate and therefore in the following we assume a general 
non-block-diagonal structure R. In fact, the relay matrix R™ is chosen such that the secrecy 
leakage is zero: (H12 + Gf RF2) P2 = and (H21 + G^ RFi) Pi = 0. Thus, the secrecy 
rate from Q can be simplified to the following 



c(l2+HiiPiPfHfi(GfRR"Gi + l2) 



(8) 
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TABLE I 

Randomly generated channel realizations for a two user two frequency interference relay 
channel with two antennas at relay and single antenna at txs and rxs. 



Hi 



Gi 



Fi 



0.5129 + 0.4605i 


0.3693 + 0.0336i 


0.4460 + 0.5281i 
0.5083 + 0.5729i 





0.1194 + 0.86241 
0.6344 + 0.1582i 









0.3504 + 0.0950i 


0.1922 + 0.4714i 



0.3608 + 0.1733i 
0.3365 + 0.0861i 





0.6012 + 0.6261i 
0.1176 + 0.8351i 



H21 



Ha 



0.4337 + 0.0709i 


0.1449 + 0.0718i 


0.3933 + 0.0111i 
0.8044 + 0.2331i 





0.9404 + 0.2720i 
0.4156 + 0.9280i 









0.1160 + 0.00781 


0.6617 + 0.0432i 



0.9339 + 0.7859i 
0.2268 + 0.4107i 





0.9213 + 0.8129i 
0.5420 + 0.1664i 



R 



IN.d 



R 



IN, 2 



-0.0364 - 0.0035i 
-0.1046 + 0.0925i 
0.2729 + 0.0708i 
0.0529 + 0.0099j 
-0.0364 - 0.0035i 
-0.1046 + 0.09251 



-0.2709 + 0.2267j 
-0.1509 + 0.02124 
0.2459 + 0.1223i 
-0.0155 + 0.1640i 



-0.1793 - 0.0233i 
-0.2837 - 0.0390i 
-0.1376 + 0.1714i 
-0.1388 + 0.0348i 
-0.1793 - 0.02331 
-0.2837 - 0.0390i 





-0.0820 + 0.1738i 
-0.3225 - 0.4885i 
-0.1315 + 0.0682i 
-0.2285 - 0.0472i 



0.0234 - 0.0575i 
-0.0832 - 0.0249i 
-0.3130 - 0.2977i 
-0.4690 - 0.3154i 





-0.3130 - 0.2977j 
-0.4690 - 0.31544 
-0.0770 + 0.0704i 
-0.2088 - 0.0485i 
-0.2702 - 0.2781i 
-0.5114 - 0.2436i 



0.0574 + 0.0596i 
0.0029 + 0.1567i 
0.2012 - 0.1606i 
-0.0414 - 0.1751i 





0.2012 - 0.1606i 
-0.0414 -0.17511 
-0.1357 + 0.1183i 
0.6810 + 0.1046i 
0.2683 - 0.2842i 
-0.0346 - 0.19604 



This motivates our following proposition on information leakage neutralization techniques. 
Interestingly, with information leakage neutralization, we can simplify the optimization pro- 
blem significantly. The idea is to set the information leakage from each user at each frequency 
to zero, in particular, by setting the equivalent channel of xi from TX 1 to RX 2 and vice 
versa in (jS]) to zero, 

' (Hi2 + Gf RF2)P2 = 

(9) 

(H2i + G^RFi)Pi = 0. 
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With the properties of the Kronecker product, ^ can be written as 



(F2P2 
(FiPi 



vec(R) = Bvec(R) 



- vec(Hi2 P2) 
-vec(H2iPil 



(10) 



The stacked matrix B in the above equation is a fat matri}^. We obtain the relay matrix that 
can perform information leakage neutralization: 

vec(R) = (BB^)"^b. (11) 

Substitute the channel realizations in Table H] into the above equation and reverse the vecto- 
rization operation, we obtain the relay matrix 'B}^ (please refer to the table for numerical 
values). 

Remark 1: If the precoding matrices {Pj} are invertible, then the relay matrix R obtained 
using (fTTI) is block diagonal. A block diagonal relay matrix means that the relay sets cross 
talk over frequency subcarriers to zero and due to the interference leakage neutralization, 
the interference from users on the same frequency is also zero. This results in KM parallel 
channels without interference. We propose in Section IIV-A| a suboptimal but very efficient 
algorithm which optimizes the achievable rates in this casec. 

In fact, the matrix in (fTTI) is not unique, any matrix which is a sum of vec(R) in ([TT]) and a 
vector in the null space of B can also neutralize information leakage, 

vec(R) = B^ (BB")"^b + z, (12) 

where z G A/'(B). With the channel realizations given in Table H we can generate another 
matrix R™'^ which achieves a higher secrecy rate 4.1553, a 17.8% increase of secrecy rate 
by optimization over z. This motivates us to investigate an efficient method to find z and 
consequently R which neutralizes information leakage and optimizes the secrecy rate at the 
same time. 

Remark 2: With the optimization over z, the relay matrix is no longer block diagonal 
which couples the frequency channels. Although the problem is more complicated, we have 
shown in the above example that one can get a better secrecy rate performance. In Section 
IIV-B[ we propose an iterative sum secrecy rates optimization over the relay matrix R and 
the precoding matrices {Pi}. 

'Care must be taken when users send less than M data streams (when Pi has zero columns. More discussion is provided 
later in Proposition 2). 

''The achievable rates here are secrecy rates as the information leakage is zero. 
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In the following section, we illustrate how the relay matrix can be chosen carefully to amplify 
the desired signal strength and at the same time neutralize information leakage in the multi- 
user scenario. 



III. General multi-user multi-antenna multi-carrier scenario 

In this section, we let the number of TXs and RXs be K >2. The TXs and RXs have single 
antenna and the relay has antennas. Let the number of frequency subcarriers be M. Denote 
the complex channel from TX i to RX j, as a diagonal matrix H^j G and the complex 
channel from TX i to relay as e C^^^^ and from relay to RX j as e C^^^^. The 
signal received at the relay is, 

K 

= ^ Fj Pi Xj +11^ (13) 

i=l 

where Fj = diag (fi(l), . . . , fj(M)) and Xj G C^^^ are the circular Gaussian transmit 
symbols from TX i, with zero mean and identity covariance matrix. The matrix Pj G 
satisfies the power constraint: 

tr(P,Pf) < (14) 

With AF strategy, the relay multiplies the received signal on the left by processing matrix 
R and transmits Ry^. The transmit power of the relay is constrained by 



ymax 
r ' 



tr 



R ^ F, P, Pf Ff + Imat j R"" j < Pr"- (15) 



The received signal at RX j is 

K 

y^. = J2 i^ji + R- F,) Pi Xi + G^" R n, + n,- (16) 

i=l 

where is the circular Gaussian noise at RX j with zero mean and identity covariance 
matrix and Gj — diag(gj(l), . . . , gj{M)). For the ease of notation, we define the equivalent 
channel from i to j as 

Hjj — Hji + Gj^ RFj (17) 

and its (/, m) -element is [H^j] = hji + gf{f)'Rfjn^i{m) which is the equivalent channel 
from user i frequency m to user j frequency /. 

Each RX is not only interested in decoding its own signal but also eavesdropping from 
other TXs. In the following, we define the worst case achievable secrecy rate with colluding 
eavesdroppers. For messages Xj, all RXs except RX i collaborate to form an eavesdropper 
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with multiple antennas and the message Xj goes through a multi-carrier MIMO channel to the 
colluding eavesdroppers. A worst case secrecy rate is then to assume that all other messages 
Xj,j 7^ i are decoded perfectly and subtracted before decoding Xj. The received signals at 
RX i and the colluding eavesdroppers are 



K 



= ^ Hjfc Pfc Xfc + Gf Rn.r + 



fc=i 



Hii 








ni 


H(i_i)j 






Rrir + 




H(i+i)i 




pH 










. Gf . 







(18) 



= H_i Pi x, + G^iRn, + n_,. 
The secrecy rate of user i is [35], 



= (^C (im P^ Pf H,, P, Pf uf^ + Cf R R« G, + Im j j 

— C ^lA/(i^_i) +H_jPjPf H^j (G^jRR^ G_j + lM(i^-i)) • 



(19) 



Recall from (flTl) that the equivalent channel from Tx j to Rx z Hj^ is a function of the 
relay processing matrix R, Hjj = Hj^ + Gf RF^. The optimization of the aforementioned 
secrecy rates is highly complicated due to their non-convex structure. In the following, we 
propose the information leakage neutralization technique [33] which is able to neutralize all 
information leakage to all eavesdroppers in the air by choosing the relay strategy in a careful 
manner. As illustrated in the previous section, with information leakage neutralization, the 
secrecy rate expression (fT9l) can be simplified to 

= C (Im +a, P, Pf h2 (Gf R R« G, + 1^/) . (20) 

In the following section, we illustrate how we can choose R to achieve a secrecy rate as 
such. 

A. Information Leakage Neutralization 

We choose R such that the equivalent channel of message Xj to the eavesdropper in (fTSl) 
is neutralized to zero. The challenge of information leakage neutralization in multi-subcarrier 
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environment as compared to the single-subcarrier case [33] is that the information leakage 
neutralization constraints must be modified to incorporate frequency sharing: 



[H,, + Gf R F,) P, = 0, i,j = l,...,K,i^ J. 



(21) 



Note that we consider the most general scenario where users may only use part of the 
spectrum and send less than M data streams and thus Pj may have zero rows and zero 
columns. In the following, we show the dependency of the number of antennas at the relay 
for information leakage neutralization on these system parameters. 



Proposition 1: The number of antennas at the relay, N, required to neutralize all information 
leakage from each of the K users at each frequency subcarrier, in a total of M subcarriers, 
satisfies 



TV > 



\ 



K -I 
M 



K 



(22) 



where Si is the number of data streams sent by TX i . 



For the proof, please refer to Appendix HI Proposition 1 offers the minimum number of 
antennas required to ensure secrecy which depends on the number of users K, the number 
subcarriers M and the amount of data streams transmitted Si. 

• If every user employs full frequency multiplexing Si = M, we have then 



K -1 
M 



K 



= ^K{K-1). 



(23) 



i=l 



As is an integer, we have N > K which is the same criteria as in the flat-fading case 
[33]. 

If every user sends Si = aM data streams and < a < 1, we have then 



K 



M 



1 ^ 

- ^ aM = >yaK{K-l). 



(24) 



For example, in a scenario of K = 3 users, M = 16 frequency subcarriers and each 
user transmits Si = 8 data streams (a = |), the relay must have at least 



i-3-2 

[v^] = 2 antennas to completely remove any information leakage from any TX to any 
RX. This is less than [a/3(2)] = 3 if all users send Si = M = 16 data streams. 
• Note that the number of antennas required for information leakage neutralization is 
independent to the number of frequency subcarriers used by each user (the number of 
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non-zero rows of Pjjfl. However, the power required to neutralize information leakage 
depends on how crowded the subcarriers is. If a lot of frequency subcarriers are occupied, 
the relay may not have enough power to neutralize all information leakage as we will 
see in the following. 

When the number of antennas at the relay is sufficient for information leakage neutralization, 
we can use the following method to compute the relay forwarding matrix R for such purpose. 



Proposition 2: Any relay matrix R satisfying the information leakage neutralization cons- 
traint (l34l) has the following form: 



vecfR) = A^b 



where 



A 
b 



vec H_i Pi 



vec I Yl_K 



z G Ar(A). 

and Pj is a submatrix of Pj, containing its non-zero columns. 



For the proof, please refer to Appendix [III From Proposition 2, it follows that there is a 

minimum power requirement for information leakage neutralization. 

Corollary 1: The minimum power required for information leakage neutralization is 



K 



prna. >(Atb)" P, Pf Pf + Im^V U Im^V (A^ b) . 



For the proof, please refer to Appendix Hill Depending on the available transmit power 
at the relay, one may only have enough power to neutralize information leakage but not 
enough power to further improve the transmission rates. If there is limited power resource 
and therefore one must ensure secure transmission with as little power as possible, then one 
can set z in Proposition 2 to zero. If there is a high priority of secrecy rates and with abundant 
transmit power, one can optimize z for the purpose of sum secrecy rate maximization. In the 
following, we investigate algorithms to address these applications. 

^The reason is that even if a user does not transmit on a certain frequency, the relay must make sure that it does not 
forward the user's information on other subcarriers to this subcarrier at which the eavesdroppers can decode the information. 
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IV. Information Leakage Neutralization Algorithms 

In the previous section, we have shown that secrecy rates (|20l) are achievable by information 
leakage neutralization. Also, in order to implement information leakage neutralization, the 
number of antennas at the relay, the number of frequency subcarriers and the number of users 
in the system must satisfy the relation in Proposition 1. In Proposition 2, we computed the 
minimum relay power required in order to perform information leakage neutralization. With 
more power available at the relay, we can improve the achievable secrecy rates by optimizing 
the relay matrix and the precoding matrices. The optimization of sum secrecy rates can be 
written formally in the following: 



K 

max > 

such that tr 1 

tr 


; c (im p, pf 

Pi pf ) < p"™"^ 

(^X:F.P.PfFf^ 


(Gf RR«G, + lAf) ') 

R"j < p;""^ 


In the following, we propose two algorithms. The first algorithm EFFIN. in Section IIV-AI 
considers the scenario where z = in Proposition 2 and all users transmit the maximum 



number of data streams allowed Si = M. We observe that in this situation, information 
leakage neutralization decomposes the system into KM parallel channels and consequently 
both the relay processing matrix R and the precoding matrix Pj can be computed very 
efficiently. The second algorithm OPTIN, in Section HV-B[ investigates a systematic method 
for the computation of R and P^ when there is enough transmit power budget at the relay 
to allow further optimization of secrecy rates. 

A. Efficient Information Leakage Neutralization (EFFIN) 

When every user transmits Si = M data streams and Pj is invertible, we propose the 
following algorithm that decomposes the K user interference relay channels with M fre- 
quency subcarriers and N antennas at the relay to KM parallel secure channels with no 
interference and no information leakage. The information leakage neutralization criteria 
(Hjj + Gf RFj) Pj = 0, when Pj is invertible, is equivalent to 

Hjj + Gf R Fj = . 

Due to the block diagonal structure of Hjj, Gj and Fj, one feasible solution of the above 
equation is a block diagonal R. With the block diagonal structure, the resulting secrecy rates 

15 



may be suboptimal, but the information leakage neutralization constraint can be broken down 
to the optimization over the diagonal blocks Rmm in 

hji{m) + gf{m)Rmmii{m) = 0, i, j = 1, . . . , K,i ^ j. (25) 

Following the same approach as before, we stack the constraints for all j ^ i and define 











= [giM,---,gi-iM 






We obtain h_j(m) + G^i{m) Rmm fj("^) = 0(x-i)xi which is 


equivalent to 








i(m). 


Stacking constraints for all i, we have 








(f^(m)®G!^i(m)) 




— h_i(m) 


A(m) = 


(f^(m) ® G«^(m)) 


, b(m) = 


- h_x(?^) 



With a limited power budget at relay, we propose to implement information leakage neutrali- 
zation with the least relay transmit power and utilize the result from Proposition 2, the relay 
matrix has the m-th diagonal block equal to 

Rmm = vec-^ ((A(m))^ b(m)) (26) 

where vec(.)^^ is to reverse the vectorization of a vector columnwise to a M x M matrix. 
After the computation of the relay matrix in (l26l) . R = diag (Rn, . . . , Hmm), the optimal 
precoding matrices {P;} are computed by solving Qi. 



K 



Qi: max VC(lM + QiW,) 

1=1 

such that tr(QJ < P''""^ i = 1, 
K 

5^tr(Q,X,)<Pr". 

i=l 



where we replace Pj Pf by positive semi-definite variable and denote the following 
matrices 

W, = (H,, + Gf R F,) " (Gf R R^ G, + Im) (H,, + Gf R F,) , 

X, = FfR"RFi, (27) 
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The objective in Qi is concave in Qj as is positive semi-definite and the constraints 
are linear in Q^. Thus, Qi is a semi-definite program and can be solved readily using 
convex optimization solvers, e.g. CVXO. The optimal Pj is obtained by performing eigenvalue 
decomposition on = Uj Dj Uf and Pj = Uj Ty]^"^ . The psuedocode of the EFFIN is given 
in Algorithm [T] 



Algorithm 1 The pseudo-code for Efficient Information Leakage Neutralization (EFFIN) 



1: for m = 1 — )• M do 

2: Compute Rmm = 



Aim) 



> Compute block diagonal relay processing matrix 



vec 



A(m))^ b(m) ) with 
(f7(m)®G"i(m)) 



him) 



— h_i(m) 

- h_/^(m) 



^ (f J(m) ® G\{m)) 

3: end for 

4: The relay processing matrix is R = diag (Rn, . . . , TImm)- 

5: Solve Qi using convex optimization solvers and obtain optimal {Qj}. 

6: for ^ = 1 — >■ K do > Compute precoding matrices 

7: Perform eigen-value decomposition, = Uj Dj Uf . Set Pj = Uj 'D\^'^ . 

8: end for 



B. Optimized Information Leakage Neutralization ( OPTIN) 

In the previous subsection, we have discussed a simple, efficient and power saving solution 
of the relay matrix and precoding matrices for secure transmission. One drawback of the 
efficient method is that its performance may be suboptimal. In this subsection, we discuss 
how to choose the relay and precoding matrices such that the sum secrecy rates are optimized 
while ensuring zero information leakage. 

To this end, we rewrite the information leakage neutralization constraint (|2TI) to promote 
the optimization of secrecy rates, 

(H + G"RF)P = T (28) 

'Given block diagonal R in i26l . the equivalent channel W,; and matrix X; are also block diagonal. It is possible to solve 
Qi using water-filling with K + 1 Lagrange multipliers. For large problem size, it may be more computational efficient 
using a tailor made water-filling method. For medium size problems and illustrative purposes, we propose here to solve by 
semi-definite programming. 
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where H = [Hn, . . . , Hi^; . . . ; H^i, . . . , H;,;,], G« = [Gf;...;G|], F = [Fi,...,F^] 
and P = diag(Pi, . . . , P/^). The block diagonal matrix T = diag(Ti, . . . , T^) is the 
new optimization variable. Tj is the equivalent desired channel from TX i to RX i as 
Ti = (Hii + Gf RFi)Pi. By applying pseudo-inversej] of G" and FP (G"^ and (FP)^ 
respectively), one can rewrite (l28l) to the following 

R = G^"^(T-HP)(FP)^ (29) 

The maximum achievable sum secrecy rate is the solution of the following problem 

K 

max V C (Im + T, P^ Pf Tf (Gf R R« G^ + Ui) (30a) 

1=1 

such that tr (Pi Pf ) < P''""^ i = l,...,K, (30b) 

(H + G^RF)P = T, (30c) 

tr (R (F P P^ F^ + Imn) R") < Pr"" (30d) 

T = diag(Ti,...,TK). (30e) 

Note that in the objective function, the information leakage is neutralized for each user. 
Constraints (I30bl) and (I30dl) are the transmit power constraints at the TXs and at the relay 
respectively. The information leakage neutralization constraint is written as (I30cl) . The op- 
timization is not jointly convex in R, T and {Pi}. To simplify the optimization problem, 
we propose the following iterative optimization algorithm. Given R and T, we solve P, 
optimally using Qi in EFFIN. 

The second part of the iterative algorithm is to compute the optimal relay strategy R and 
the auxiliary variable T (by solving Q2) if the precoding matrices Pj as the solutions of Qi 
are given. 



Q2: max 5^c(lA/ + T,Tf (Gf RR«G, + lAf) ') 

i=l 

such that R= G^t(T-HP) (FP)^ 

tr (R (F P P^ F^ + Imn) R") < Pr 
T = diag(Ti,...,T^). 



ymax 
r 1 



'Note that has dimension MK x MN and FP has dimension MN x KM. If MN > MK, then G^t 
G(G"G)"^ and (FP)"^ = ((F P)^ (F P)) ~\f P)". If MN < KM, then G^t ^ (GG")"^G and (FP)^ 
(FP)" (fP(FP)"'; 
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Problem Q2 is non-convex. The major challenge is due to the sum of log-determinants in the 
objective function and the equality constraints. In the following, we utilize the first equality 
constraint and replace R as a function of T. The optimization problem Q2 can be written 



as, 



K 

: max ^ (c (x, +T, Z, xf ) - C (x, +T, Y, xf 



such that 



i=l 

tr (G"t(T-HP) {y + Imk) (T-HPf G^) < P, 
Tj = [Tj, 1m] , 
T = diag(Ti,...,Tx). 



max 
r ' 



Please see the proof and the definition of Xj, Yj, Zj in (|4TI) in Appendix |IVl Although the 
optimization problem is simplified, it is still non-convex in T. In the following, we propose 
to solve Q2 with gradient descent method. To this end, we write the Lagrangian of Q2 as 
L(T,A), 



K 



(31) 



(32) 



L(T, A) = ^ (C (X, +T, Z,, Tf ) - C (x^ +T, Y, f f 

i=l 

- A (ti (g^^ (T - HP) (^F + Imk) (t - HP)^ g^) - p;""^' 

K 

= J]/,(T,)-A(?(T). 

i=l 

The gradient of the Lagrangian with respect to T* is 

1 Om ^^t;/2(T 

Dx-L(T.A)^^ 

Om 

- AG1" G"^(T-HP) (f + Ikm 
Please see the proof in Appendix El We summarize in Algorithm |2] the proposed iterative 
algorithm on sum secrecy rate optimization. 

V. Simulation Results 

To illustrate the effectiveness of the proposed algorithms, we provide in this section 
numerical simulations for different system settings. As an example, we simulate the secrecy 
rates of a relay assisted network with K = 2 users, Af = 8 frequency subcarriers and N = 2 



Om 

Om 
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Algorithm 2 The pseudo-code for Optimized Information Leakage Neutralization (OPTIN) 
1: while do > Compute relay processing matrix 

2: Initialize {P, } and R as the solutions of EFFIN. 

3: Solve Q2 using gradient descent method with gradient (l32l) and obtain optimal 

solution T. Obtain relay processing matrix R from T using (|29l) . 
4: With R and T above, solve Qi using convex optimization solvers and obtain optimal 

{QJ- 

5: for i = 1 — )• do > Compute precoding matrices 

6: Perform eigen- value decomposition, Qj = Uj Dj Uf . Set P, = Uj D)^^. 

7: end for 

8: if sum secrecy rate improvement is less than a predefined threshold then 

9: Convergence reached. Break. 

10: end if 
11: end while 



antennas at the relay, unless otherwise stated. To examine the performance of the algorithms 
with respect to system signal-to-noise ratio, we vary the transmit power constraint at relay 
from to 30 dB while keeping the transmit power constraint at TXs as 10 dB (see Figure [3j) 
Similarly, we examine the algorithms by varying the transmit power constraint at TXs from 
to 30 dB while keeping the transmit power at relay constraint at 23, 27, 30 dB. Note that by 
varying the power constraints, we do not force the power of the optimized precoding matrices 
and the relay processing matrix to be equal to the power constraints. In the following, we 
compare algorithms: 

• Baseline 1 (Repeater): the relay is a layer 1 relay and is only able to forward signals 
without additional signal processing. This corresponds to setting R = I^/jv \j ^^"^ ■ 

• Baseline 2 (IC): the relay shuts down, i.e. R = Omn, and we obtain an interference 
channel where users eavesdrop each other. 

• Proposed algorithm EFFIN: an efficient relay and precoding matrices optimization al- 
gorithm outlined in Algorithm \T\ 

• Proposed algorithm OPTIN: an optimized algorithm whose performance exceeds EFFIN 
with a price of higher complexity. OPTIN is outlined in Algorithm [2l 
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For each baseline algorithm, we examine the effect of spectrum sharing on achievable secrecy 
rates by employing either one of the following spectrum sharing methods: 

• Full spectrum sharing (FS): users are allowed to use the entire spectrum. Each TX 
measures the channel qualities of the direct channel and the channel from itself to other 
RXs. Based on the measured channel qualities, each TX excludes frequency subcarriers 
with zero secrecy rates and transmits on the channels with non-zero secrecy rates. For 
subcarriers at which more than one user would like to transmit, we assume that the TXs 
coordinate so that the TX with a high secrecy rate would transmit on that subcarrier. 
Despite such coordination, each user eavesdrops other users on each subcarrier. 

• Orthogonal spectrum sharing (OS): users are assigned exclusive portion of spectrum. 
Each TX excludes subcarriers with zero secrecy rates and transmits on the channels 
with non-zero secrecy rates. Each user eavesdrops other users on each subcarrier. 

A. Secrecy rates with increasing relay power 

In Figure [3l we show achievable sum secrecy rates over varying the transmit power 
constraint at the relay from to 30 dB while keeping the transmit power constraint at 
the TXs at 10 dB. As the IC does not utilize the relay, the achievable sum secrecy rates 
(plotted with triangles) are constant as the relay power constraint increases. As expected 
from intuition, the performance of IC with FS is better than OS because OS has an additional 
constraint of subcarrier assignment. The achievable sum secrecy rates achieved by a repeater 
decreases with relay transmit power. This is due to the increased amplification noise in AF 
relaying. Interestingly, the non-intelligent relaying scheme, e.g. a repeater, may decrease the 
secrecy rate significantly, even worse than switching off the relay. However, utilizing an 
intelligent relay and choosing the relaying scheme, one can improve the achievable secrecy 
rate significantly, about 550% over a simple repeater and about 200% over IC. Although 
EFFIN is very simple and efficient, it achieves 94.5% of the sum secrecy rate achieved by 
the more complicated algorithm OPTIN. 

B. Secrecy rates with increasing TX power 

In Figure m we simulate the achievable sum secrecy rate by the transmit power constraint at 
TXs from to 30 dB while keeping the transmit power at relay constraint at 23, 27, 30 dB. As 
the transmit power at TX increases, the sum secrecy rates saturate in both baseline algorithms. 
Repeater and IC. With the proposed information leakage neutralization, we see that the 
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P;""^(dB) 

Fig. 3. The achievable secrecy rates of a two-user IRC with 8 frequency subcarriers is shown with varying relay power 
constraint. The TX power constraints are 10 dB and there are two antennas at the relay. The proposed scheme EFFIN and 
OPTIN outperform baseline algorithms Repeater and IC by 550% and 200% respectively. 

sum secrecy rates grow unbounded with the TX power as each user enjoys a leakage free 
frequency channel. Note that the sum secrecy rates achieved by relay with power constraint 
at 23, 27, 30 dB are plotted in dotted, dashed and solid lines respectively. When there is only 
23 dB available, there is only enough power for information leakage neutralization, but not 
enough to further optimize the system performance. Hence, the achievable sum secrecy rates 
of EFFIN and OPTIN overlap. With more power available, it is possible to optimize the sum 
secrecy rates while neutralizing information leakage and the performance of OPTIN is better 
than EFFIN. 

C. Secrecy rates with larger systems 

In Figure [51 we examine the performance of the proposed algorithms in a slightly larger 
systems with = 4 antennas at the relay and M = 16 frequency subcarriers. The relay 
processing matrix is therefore a 64 x 64 matrix. The proposed scheme EFFIN and OPTIN 
outperform baseline algorithms Repeater and IC by 200% whereas the efficient EFFIN 
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r 
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r 
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r 
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r 
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Fig. 4. The achievable secrecy rates of a two-user IRC with 8 frequency subcarriers is shown with varying transmitter 
power constraints. The relay power constraint is 30 dB and there are two antennas at the relay. The secrecy rates achieved 
by EFFIN and OPTIN grows unbounded with the transmit power at TX whereas the secrecy rates achieved by baseline 
algorithms saturate in high SNR regime. 



algorithm achieves 94.86% of the sum secrecy rate performance by OPTIN. 



Appendix I 
Proof of Proposition 1 

If TX i transmits Si < M data streams, then M — Si columns of Pj are zeros. For example, 
in a system with 4 subcarriers where TX i transmits 2 data streams spread over 3 subcarriers. 
Pi has the following form. 



(33) 



* * 

* * 


* * 

Denote the non-zero columns of Pj by Pj G C*^^'^'. The information leakage constraint (|2T]) 
is equivalent to 



(H,, + Gf RF,) P, = 0, 



(34) 
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Fig. 5. The achievable sum secrecy rates of a two-user IRC with 16 frequency subcarriers and 4 antennas at the relay is 
shown with varying relay power constraint. The TX power constraints are 10 dB and there are two antennas at the relay. The 
proposed scheme EFFIN and OPTIN outperform baseline algorithms Repeater and IC by 200%. EFFIN achieves 94.86% 
of the sum secrecy rate performance by OPTIN. 



For each i, we stack the constrains for all j 7^ ^ by using from (fT8l) and defining 

XT _ r-rrH ttH ttH ttH iH 

-ti-i — [n^j, . . . , n(._;^)., n(._^^)-, . . . , n^-j . 

We write dMl) as 

(H_, + G« RF,)P, = 0, t = l,...,K (35) 

which can be manipulated to the following by performing vectorization on the matrices, 

( (pj F7) ® G«,) vec(R) = - vec (h^^ P,) , i = l,...,K. (36) 

The matrix H_j has dimension {K — 1)M x M and the matrix Pj has dimension M x Si. 
Hence, the product H_j Pj has dimension (K — 1)M x Si. The number of constraints in (l36l) 
is the number of elements in H_j Pj, which is (K — l)MSi. Summing up all constraints for 
i = 1, . . . , K, we have the total number of constraints {K — 1)M J2f=i ^i- The number of 
variables is the number of elements in R which equals to M'^N'^. To neutralize information 
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leakage at all users, we must satisfy (l36l) for all i. To this end, the relay must have the 
number of antennas satisfying W^N"^ > {K - l)MJ2f^-^ Si, or 



K 



M 



i=l 



Si. 



(37) 



Appendix II 
Proof of Proposition 2 

Stacking the matrices in (l34l) for all i, we obtain A vec(R) = b. The matrix A is a block 
matrix with vertically stacked blocks ^Pj F^j ® G^i , for i = 1, . . . , K, and therefore has 
dimension Yl!i=i Si{K — 1)M x M^N^. The matrix G i concatenates matrices Gj for j ^ i, 
e.g., G_i = [G2, . . . , Gk]- As G_j are not mutually independent, A is of low rank. Denote 
the number of rows of A by a = X^ili i3i{K — 1)M and the rank of A by /? = rank(A). 
The pseudo-inverse of A can be computed by performing singular-value-decomposition on 
A, 



[Ui I U2 



V 



(38) 



r Ol3x{M'^N^-l3) 

where Ui G C"^^,U2 G C°^*^"~'^^ are the left singular vectors in the signal space and null 
space of A respectively; Vf G C^x*^'^', vf G c^*''^'^^)^*''^' are the right singular 
vectors in the signal space and null space of A respectively; T G C^^^ holds the non-zero 
singular values in the diagonal and zeros everywhere else. Thus, the solution of vec(R) 
satisfying Avec(R) = b is 

vec(R) = ViT-^Uf b + Vsy (39) 

where y is any vector in the space of xhe result follows by setting z = as 

a vector in the null space of A. 



Appendix III 
Proof of Corollary [I] 

Using the properties of Kronecker products, the relay transmit power from (fT5l) is equivalent 
to (A^ b + z)" ((e£i Fi Pi Pf Ff + Imn) ® Imn) (A^ b + z). By Proposition 2 and (O, 
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the minimum transmit power required to satisfy information leakage neutralization is 

min ( At b + z) " [ (j2 + ) ® ) (^^ b + z) 

VV-i / / (40) 

(Atb) |^5^F,P,PfFf + lMivj (Atb)''j <Pr^ 

where the transition is due to the fact that z is in the null space of A and the fact that 
Q = ^Xlili Pi Pf Ff + Imn^ ® Imat is positive semi-definite and z^ Q z > for any z. 

Appendix IV 
Formulation of Q'^ 



Let Ef = ef ® Im, T, = [T^, 1*/] and 



K K 



F = (F P)t (F P)^t , X, = 5^ ^ P„ F„, Pf Hf , 
F- 

J. 77 



m=l Z=l 



-EtiF.PfH- 



(41) 



Om Oa/ 

With the equality constraint (l28l) . the amplification noise can be written as (l42l) where Pmi G 
C*^ is the (m, /)-th block matrix in F. As a result, the objective can be written as 

K 



J]c(lA/ + T,Tf (GfRR^G, + lM) ') 

i=l 

= 5^ (c(lA^ + T,Tf + GfRR«G,) 

i=i \ 

-C(lAf + Gf RR«G,) 

K / 

= J] C (x, +f , Z, f f ) - C (x, +f , Y, Tf 

i=i V 



Similarly, the power constraint is written as (I43I) . 
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= (T - H P) (F P)^ (F P)""^ (T - H P)" 



[— Hji Pi, . . . , Tj — Hjj Pj, . . . , — HiK Pk] 



Fii ... F 



' Kl 



IK 



KK 



pH ttH 



rpH _ pH ttH 

i i ii 



pH ttH 



K K 



K 



K 



Hjm Pm Pf — Tj Fj/ Pf H^^ — Hj^ Pm mi Tf + Tj Fjj 



m=l i=l 



m=l 

EKiF.PfH^ 









Im 



Xj — Im +Tj Yj Tj , 



i421 



tr (R (FPP^ F^ + Imw)R«) 

= tr (^G^"f(T-HP) (FP)'^ (F P P" F" + Imw) (F P)'^" (T - H P)^ G'^) 
= tr (^G^t(T-HP) (^(FP)^(FP)^" + Ixm) (T-HP)^G^ 
= tr (^G^^(T-HP) (^F + Ixm) (T-HP)"Gt) < P,"'"^ 



(43) 



Appendix V 

Computation of the gradient of Lagrangian (I3T]) 



Recall the Lagrangian from (1311) . 

L(T, A) = ^ (C (X, +T, Z, Tf ) - C (x, +T, Y, f f 

i=l 

- X (tr (^G^t (T - HP) (^F + Imk) (T - HP)^ G^) - P^"") 



5]/,(T0-A^(T), 



1=1 



where /^(Ti) = C +Ti xf j - C (Xi +Ti Y^ xf j denotes the secrecy rates of TX i 
and g{T) denotes the power constraint. We compute the gradient of the Lagrangian (|3T]) with 
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respect to T, 



K 



i=l 



As fi{Ti) is independent to for j ^ i, the derivative can be written in a block diagonal 
form 

Pt* L{T, A) = diag (Pt^ /i(Ti), ■ ■ ■ , 2^t;, /if(Ti^)) - APt* ^(T). (44) 
The gradient of the objective function /j(Tj) with respect to T* is 

T>T^ MTi) = Dt* C (x, +T, Z, Tf ) - Vt* C (x, +T, Y, xf ) . (45) 
We begin with 

ln(2)PTrC(x,+T,Z,Tf) 

= Pt* In det (Xi +% Zi f f ) • Vt* T* 



= vec ( ( X, +T, Zi tf 
vec( (X,+T,Z,Tf)~' 



T,:Z, 



(0 

(x,+T,Z,Tf)"'T,Z, 



T 



^voc(t:) 

avec(T*) 

0m2 



+Tj Zj 



(:,1:M) 

Im +Fjj 



Similarly, we have 



ln(2)PT|C(x,+T,Y,Tf) 
= (x,+T,Y,Tf)"'T, 



Thus, we have the gradient of /i(Tj) as 

-R2)((^^+^^^^^^' 
- I (X,+T,Y,Tf)"'l 



5!^m=l I^j"! Pm F,^ 
F- 



(46) 



(47) 



(48) 
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The last step of computing the gradient of the Lagrangian is to compute 
Pt* tr (g^ ^ (T - H P) (f + 1km) (T - H P)" G^) 

= Gt G^t(T_HP) (f + Ikm). 
Combining (l44l) . (I48l) and (|49l ). the gradient of the Lagrangian is obtained 
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